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[57] ABSTRACT 

A signal processing method and apparatus for provid- 
ing interpolated values between sampled values in a 
sampled image signal, is characterized by providing a 
plurality of different interpolation routines for produc- 
ing interpolated signal values for appropriately com- 
pleting a respective plurality of known features, detect- 
ing which of the geometrical image features is repre- 
sented by a neighborhood of sample values and apply- 
mg the interpolation routine appropriate for completing 
the detected feature, to produce the interpolated signal 
value. The signal processing method and apparatus has 
the advantage that reconstruction errors in the repro- 
duced image are reduced. In one mode of the invention 
for processing images to be viewed by humans, recon- 
struction errors are forced to occur in areas of the image 
composed of natural textures where the errors are not 
readily visible to the human observer. The appearance 
of the reconstructed image is thereby improved. 

2 Claims, 24 Drawing Figures 
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that reduces the reconstruction errors in an image re- 

SIGNAL PROCESSING METHOD AND constructed from the processed image signal. 

APPARATUS FOR SAMPLED IMAGE SIGNALS TVT,r«v,^T^xT 

DISCLOSURE OF THE INVENTION 

TECHNICAL FIELD 5 It is the object of the present invention to provide a 

The invention relates to a signal processing method processing method and apparatus for interpolat- 

and apparatus for providing interpolated values b^ values between sampled values in a sampled 

tween the sample values m a sampled image signal. "S"^: ^^^^^^ reconstruction errors m an 

imitge reproduced from the processed image signals are 

BACKGROUND ART 10 reduced. 

In a single^hip color image sensor, image sensing ^f^^ ^ f,.^ invoition u. achieved by 

elements for luminance information (e.g green or an mterpolation method that uses pnor 

, . ^. „ * J L • ^ ^ ^ knowledge about features existmg m the miages beuig 

wmiej are spanaiiy separata oy unage sensing elements .econstnJcted. A plurafity of different interpolation 

for chrominance mfonnat»n (e.g. red and blue or cyan ,j „^ for completing the r^pective 

and yeUow) leaymg gaps between the laaunance sam- feature s. Local neighborhoods of image samples around 

pies m fte lummance signd Pf oduced by the image an interpolation locaton a«^»^ and Ae nartjcu - 

sensor. These gaps are usually filled m by some signal l ar featiJre existing in the nriehWhood is detegt«l . then 

P'JfrS'^ "^f*?**. "X",',"^* Tv?°^*^;„™ the i nterpolation routine appropriate for the detected 

U S. Pat. NO. 4,176,373 issued Nov. 27. 1979 to P L. 20 featuJ? is applied. By using the prior knowledge about 

P. DiUon, shows a method for processmg sampled the features existing in the image, the reconstruction 

image signals produced by an image sensor having a ^ ^he image reproduced from the processed 

checkerboard luminance sampling pattern. The method image signal are reduced. 

involves linear interpolation (equivalent to finding the when the signal processing method is appUed to 

mean of the neighboring samples). The patent discloses 25 image signals intended for human viewing, geometrical 

linear interpolation along a horizontal line, and men- features such as edges, lines and comers are assumed to 

tions that the method could be carried out in two di- exist in the image, and the interpolation routines are 

mensions by using samples from neighboring lines. f ashioned ffVf"<''^^" f Fl v rRmnctnirtinn prrnrc rf>- 

FIG. 1 shows a color sampling pattern for a single- maining in the reproduced image occur mainly in natu- 

chip color image sensor. The lummance sampling ele- ral objects having more irregular features, such as foi* 

ments, labeled G, are separated by chrominance sam- lage, where the reconstruction errors are hardly notice- 

pling elements, labeled R and 6. FIG. 2a represents an able to a human observer. As a result, the appearance of 

image of a sharp vertical line. The e lements labeled 100 the reconstructed image is significantly improved. 

represent high bright ness and the elements l^eled 0 The signal processing method is characterized by: (1) 

represent low bnghtn^. FIG. 26 r epresents the sam- providing a pli^rflltty nf Hiff>Tent ^ pterpolfltjon routines 

piea ^ues obtained from samplipg )the image of FIG. for producing interpolated signal values appropriate for 

2a witb me iwmnance sampling pattern of FIG. 1. compledngarespectiveplurality of known geometrical 

When linear interpolation is applied to the values shown image features; (2) detecting which of the known geo- 

in FIG. 2b, using the values of the four nearest neigh- metric^ im a^g featurej^ i« represented bv a nei ghboy- 

bors (i.c top, bottom, right and left) surrounding each h ood of sample values ; and (3) a pplying the interpola- 

interpolation location, the pattern illustrated in FIG. 2c t ion routme appropriate for completing the detected 

is obtained. f eature to the nd^poring sample values to produce Ac 

As seen in FIG. 2c, the originally sharp vertical edge i nterpolated signal value ; 
has been modulated with a pattern corresponding to the In a preferred embodiment of the invention, for pro- 
luminance sampling pattern. Similarly, when a thin cessing a sampled image signal from an image sensor 
stripe, such as the vertical stripe shown in FIG. 3a is having a checkerboard-type sampling pattern, for pro- 
sampled (the resulting samples are shown in FIG. Zb% ducing images intended for human viewing, the image 
and reconstructed using linear interpolation between features are detected in a four-sample local netghbor- 
the four nearest neighbors, the stripe is modulated with ^cmmI- fea ju^^ include an fedgg. « fitrip>^ 
a pattern corresponding to the lummance sampling .ner^For the edge feature, the interpolation routine com- 
pattem as shown in FIG. 3c • P"^^ producing the median value of the four surround- 
In an image intended for human viewing, these recon- sample values, where the median is defined as a 
struction errors are most objectionable in geometrical ^^^^ halfway between the two middle sample values, 
details such as edges, lines and comers. In an image 55 f ^ttiP® f^^mre, the interpolation routine is a 
intended for machine interpretation, such as a robot ^^^^lon of the twelve nearest neighbors defined as 
vision system used in a factory, the reconstruction eir- 

rors are most objectionable when they interfere with _^ D - 

the efficient operation of the system. For example, ^ ^ (m cs m)) 

when the reconstruction error results in ambiguity as to $0 

the identification of a part of an assembly line. where: 

Of course, the reconstruction errors may be reduced X is the interpolated value, 

by increasing the number of image sensing elements in A^B^C^Darethe values of the four nearest 

the image sensor but this increases the cost and com- neighboring samples in ra^^rder, 

plexity of the image sensor. 65 M is the median valu e of th/fo^iearest neighboring 

There is a need therefore for a signal processing samples, _ ^^""^^ 
method and apparatus for providing interpolated values S is the mean valu e of th^g^ next nearest neighbor- 
between the signal values in a sampled image signal, ing samples, and ^--^ 
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FIOS. 11-14 are flow charts useful in explaining the 
cuPiJ(0 = J J S i signal processing method according to the present in- 

iifk^i^J vention. 

^'^'^'^ 5 MODES OF CARRYING OUT THE INVENTION 

The interpolation routine for the comer detail is a simi- The invention will be illustrated with an example of a 
lar clipping function defined as signal processing method for sampled image signals, 

where the image is intended for human viewing. The 
B features that are presiimed to be in the image are lines, 

X = CUP (M-(S'-M)) 10 starp edges, and comers, f eatures to which the human 

visual system is particularly sensitive. 

where: S' is the mean value of th/Q)n£xt neacst ,^ noted above, interpolating values betwaen sam- 

"\^t . ^r^" j*""^ «jiiiuuj/i4g^ plg^ values m a sampled unace signal by using the mean 

neighbonng samples that straddle tEe boundary be- ^ . ^ *v * *^ M«»e,. womg m*c uicoi« 

* f. w**" 7 value of the four nearest neighbonng samnles fails to 

twccn the light and dark members of the four nearest j5 • w„™ cl ^7^^^^-^^ i7^1i« 

. , K« 1 preserve image features such as sharp edges or thin 

neignoormg samples. reconstructed from the pro 

BRIEF DESCRIPTION OF THE DRAWINGS cessed image signal. These reconstruction errors are 

Modes of carrying out the invention are described P^^'^/V noticeable to the human observer, because 
iTiuuw ui uivoiuuii ttic uwwiuco ^ features to which the human visual system is 

witt^ respect to the dra>wngswhercm: 20 ^^ost sensitive. If, instead of the mean value of the four 

FIG. 1 IS a «:hematic diagram of a single^hip color ndghhoA, a median of the four nearest neigh- 

image sensor havmg a checkerboard luminance sam- * . . . - i * . 

ujiagi^ acuaui imvuiB a ^.uc^iwtiuuaiu iumu«m^ ^^^^^ ^ ^^^^ ^j^^ ^^^^ ^j^^ ^ TepiO- 

^ cfr? -I • ' - J 1- J v • *t, I • duced as shown in FIGS. 4 and 5 respectively. The 

FIG. 2a IS an ideahzed diagram showmg the lumi. ^^^^ ^ ^^^^^ ^^^^ ^ J J 

nance values m a portion of an image havmg a sharp 25 ^he values of the two samples having middle values 
vertical edge, when the four samples are ranked A=B=CsD 

FIG. 2b shows the sampled luminance values ob- ^ 
tained by sampling the idealized image shown in FIG. 

2a with the luminance sampling pattern of FIG. 1; M = ^ '^^ 

FIG. 2c shows the luminance values obtained by 30 
inteipolatwg the valu« be^veen sampled luminance As can be seen in FIG. 4, the median M is an apmonri. 
vidues m FIG. 2b with two^imensional linear mterpo- ate interpolation routine for reconstmctiaE the shan > 
•. • J !• J J- !. ..>.•- cage, but as shown in FIG. 5, the stripe is still modu- 

HG. 3a IS im Ideahzed diagram showmg the lumi- ^ ^ „ corresponding to the sampling 
nance values of a narrow vertical Ime; 35 ^^^^^ a 

T7¥^ -it 1. 1 J 1 • 1 1^ pattern of the image sensor. A dinerent mterpQiatiQn 

FIG. 36 shows the sampled lummance values ob- Il„f:«^ r^^«c*«w c^«* 

* . J - I- • r T-T^ o -.t. ^i- 1 ro n tm e is requir ed to rec onstruct the stnpe. 
tamed by samphng the image of FIG. Za with the lumi- a IS?..^!^^^ o>> a^»^\^^ 
nance sampling pitem of FIG. 1; /^Appropriate interpoiatton routine^ m if^^j^^ 

nr^ ^ u 1 , ^ , ^ ' ^ ^ I the image sa mphng patte rn \and the features that are 

FIG. 3c shows the lummance values obtamed by • ^,ABumjSj *^ ^wL* *t tu- »^«.*^»^.»«,»» «f 

, ^, ^, , , ^ t . , . presumcolo exist m the image. The appropriateness of 

mterpolatmg the valu« be^veen sampled lummance 40 L interpolation routine may be assess^ by processing a 
vdues m FIG. 36 with two-dmiensional hnear mterpo- ^^esentotive group of images with the iiterpotation 

* A I. *u 1 • 1 • J t- • routine and measuring the RMS reconstruction errors 
FIG. 4 shows thelwm^ce values obtained by mter- ^ reconstructed. 

polatmg the values between the sampled lummance TT ur ^ ^ 

1 cTJxr^ 1 • J* However, before an appropriate mterpolation routme 

values of FIG. 2a nsmg the medum of neighbonng sam- 45 ^^^^ will be de- 

FIG. 5 shows the luminance values obtained by inter- id«.tifying the features in the local neigh- 

polating the values between sampled luminance values '° W'-Pnate mterpotofon routme 

in^FlG. 36 using the median of neighboring sampled ° jo id|.V ^e local feature, the four nearest ndeh- 

FIGS. 6a-66 show the geometrical feature classified tf^B values (above, bej^YfjaiJis^imBSiJa 

as an edge b an embodiiient of the signal processing mterpolatton location are daR^iflpri rithrr grratrt 

method according to the invention; ^ or less than (L) the mean value fm) of the four 

FIG. 6c shows the geometrical feature classified as a °e'8hb°nng sample values, where. 

Stripe in an embodiment of the signal processing method 55 

according to the invention; m - 1 7V(/4 

FIG. 6d shows the geometrical feature classified as a i 
comer in an embodiment of the signal processing 

method according to the present invention; where: N/ are the neighboring sampled values. 

FIGS. la~b show patterns useful in describing the 60 There are three possible patterns, their rotation 

interpolation method for stripe^ jptrrnr jjma^eR. These patterns are called the^^ 

FIGS. show patterns useful in describmg the C^ yRIP£) and the CORNER patterns. The E\ 

interpolation method for comers; shown in FIGS. 6a and 6b , the STRIPE is shown m 

FIG. 9 is a schematic diagram showing computer FIG, dc. and the CORNER is shown m FIG. titf. The X 

controlled apparatus for generating, processing and 65 in the FIGS. 6o-J indicates the interpolation location, 

displaying a sampled image signal; An appropriate interpolation routine for the EDGE 

FIG. 10 is a block diagram useful in describing the pattern (the median) was described above. For the 

functions performed by the digital computer; and STRIPE pattern, there are two simple cases, a vertical 
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stripe shown in FIG, la. and a horizontal stripe shown 
in FIG, lb . These two cases arc not distinguished using 
only the four nearest neighbors. 

To distinguish the two cases, the eight next nearest 
neighbors are included in the interpolation routine and ^ 
an appropriate interpolated value is the CLIP function: 



(3) 10 



where: 

B and C are the middle ranked sample values of the 

four nearest neighbors as described above, 
M is the median value as defmed by equation (1), is 
S is the mean value of the eight next nearest neighbor- 
ing samples, and 



H L H m m L 
HLL HHLHLmmLH 

H L ' . m m m m 



Neighborhoods that could be either STRIPE or EDGE 
are better treated as STRIPE, and neighborhoods that 
could be classified as STRIPE or CORNER, are treated 
the same by either the STRIPE or the CORNER 
method. Accordingly, the following patterns, their mir- 
ror images and rotations arc classifieid as STRIPE. 



H H L H 
L.LLLHHLm 
H ID in (D 



fiTk £iSJ 



Applying this interpQlation routine to th^ g an^ plea 
strine nat^fip shown in FTG. 3fe. it is seen that the nroc^. 
dure properly reconstructs the original stripe pattern ^' 
without reconstruction errors. To provide input data 
for the interpolation routine near the top and bottom of 
the portion of the image shown in FIG. 3^, it is assumed 
that the stripe pattern extends in the vertical direction, 

Similarly, for the CORNER pattern, there are several 
possibilities that are not distinguished by the four near- 
est neighbors, i.e. a light comer on a dark background 
(FIG. Ha)t a diagonal edge (FIG. Sb), and a dark comer 
on a light background (FIG. 8c). To distinguish these 35 
three cases, four more next nearest neighboring samples 
are used. The samples used are the ones that straddle the 
boundary between the light and dark members of the 
four nearest neighbors and are indicated by stars (*) in 
FIGS. Ha-c). 40 

An appropriate interpolation routine that recon- 
structs the comer feature is the CLIP function: 



X = CLIP (M-(S*-M)) 

c 



55 



where: 

X is the interpolated value, . 



is defined as above, 
M is the median value of the four nearest neighboring 
samples, and 

S' is the mean value of the four next nearest neighbor- 
ing samples that straddle the light/dark boundary. 

In 5-10% of the interpolation neighborhoods of the 
average photographic image, the classification as ^ 
EDGE, STRIPE, or CORNER is ambiguous because 
neighboring sample values are either equal to each 
other or to the mean (m). Neighborhoods that could be 
either EDGE or CORNER, are preferably treated as 
EDGE, and neighborhoods where all the Rjtfnplft.g are 65 
egual are properly treated by th e median intemolatio n 
routine. Accordingly, the followmg patterns, their rota- 
tions and mirror images are classified as EDGE. 



The only remaining pattern is the CORNER. 

H 
L H 

20 L 

Referring now to FIG. 9, apparatus for generating, 
processing and displaying a sampled image signal is 
shown. An image sensor 40, such as a CCD frame trans- 
fer image sensor, having a checkerboard luminance 
sampling pattern like that shown in FIG. 1, produces a 
sampled analog signal on line 42. The sampled analog 
signal is converted to a digital signal by an analog-to- 
digital converter 44. The digital signal is supplied to a 
digital computer 46 on a data bus 48. The digital com- 
puter 46 performs the signal processing according to the 
present invention to interpolate luminance values be- 
tween the luminance samples of the signal. The com- 
puter includes a frame store 50, for storing the unpro- 
cessed image signal and the processed image signal 
including the interpolated sample values, a central pro- 
cessing unit (CPU) 52, and random access and read only 
memories (RAM and ROM) 54 and 56 for storing the 
programs that control the computer 52. The frame store 
may comprise either a digital frame store comprising 
solid state memory elements, or a conventional memory 
device such as magnetic tape or disc storage. The pro- 
cessed digital signal is supplied to an output device such 
as a CRT 58 or a graphic arts scanner 60 via digital-to- 
analog converter 62. 

Although the elements of the apparatus are shown 
physically connected by bus 48 in FIG. 9, the elements 
may be separated and the signals carried between the 
elements by storage media. For example, the sampled 
analog signal from the image sensor may be recorded 
directly on a magnetic tape recorder and later supplied 
to the computer for signal processing. Similarly, the 
processed sampled image signal may be recorded for 
later display. 

Although the invention was reduced to practice using 
a general purpose digital computer, it will be apparent 
to one skilled in the art, that a programmed micro- 
processor, or custom designed bitegrated circu its can be 
used to practice the invention. ~ 
The signal processing function performed by the 
computer will now be described wi5i reference to the 
block diagram of FIG. 10 and the flow charts of PIGS. 
11-14. 

Referring first to FIG. 10, the computer 46 is pro- 
grammed to implement a plurality of signal processing 
means 64, 66 and 68 responsive to the sampled signal 
values in the image signal S for producing interpolated 
signal values S' appropriate for completing a line, edge 



45 



50 
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or comer feature, respectively. A feature detecting the images reproduced from sampled image signals that 
means 70 is responsive to the sampled signal values id were processed by using linear interpolation between 
the sampled image signal S in the neighborhood of a the sample values. The appearance of geometrical detail 
interpolation location for detecting which of the geo- \^ the geometrical features of the reproduced images 
metric features is represented by the signal values, for 5 using the signal processing method of the present inven- 
producing a signal representative thereof. Signal pro- ^^^^ ^^^y improved. Careful scrutiny of the natu- 
cesser selecting means 72 is responsive to the signal ^^^^ ^^^^ ^ reproduced 
from the feature detectmg means for selecting the ap- ^ ^^^^^ ^^^^ ^. 
propnate signal processmg means for producing the _ . . . , . - .. ^- 
intcSrpoIatcd signS value. The appropriate signal pre lo ^^J^^^, *>=cn r«wicrcd m a manner r<^imscent of a 
cessing means is selected, as indicated schematically by ^^^^^^ P^^/; However these reconstruction errors 
multiple position switch 74 controlled by signal proces- ^^^e not readily noUceable to the human observer, 
sor selecting means 72, to produce the interpolated mvention as dcscnbed is directed to mtcrpola- 
signal value S'. luminance signals. In practice, the sampled chro- 
Referring now to FIG. 11, the computer program 15 minancc values are also interpolated, using methods 
will be described with reference to the flow charts. The known in the prior art to reconstruct a full color image, 
computer 46 retrieves the luminance values of the four Although the invention has been described with ref- 
nearest neighboring samples surrounding the interpola- erence to a preferred embodiment wherein a human 
tion position from the frame store memory 50. The viewable image was sampled in a checkerboard pattern, 
mean value (m) of the four nearest neighbors is calcu- 20 the invention can be applied to other sampling patterns 
latcd. Next, the value of each neighbor N/ is compared such as stripe patterns where the distances between the 
with the mean value m to determine whether it is larger samples is different in two dimensions, and also for 
(H), smaller (L), or equal to (m) the mean. The resulting patterns where the distances between the samples occur 
pattern of H^s. L's and m's is checked to determine i^cgularly in cither one or both dimensions. The invcn- 
n^^^Z'^ f EDGE pattern a STRIPE patter or a 25 tion can also be used for machine viewable images, 
Ji^s^^inS^^^^^^^ wherethepnorknowi^fthef.^^ 
If the pattern is determined to be an EDGE, the f^T"^ imurhme enviromnen^^^ 
interpolated value X is determined as shown in FIG. 12 Although the mvention has been descnbed as bemg 
by computing the median value M defined as the aver- 30 embodied by signal processmg apparatus havmg a full- 
age of the two central valued samples in the four sample s^o^e* ^ apparent to one skilled in the art 
ne ighborhood. that the apparatus need store only a few lines of the 
^^If the pattern is a STRIPE, the interpolated value X image signal at one time in order to perform the signal 
is determined as shown in FIG. 13. First the four neigh- processing method. 

boring samples arc raiJad and the median M k deter- 35 ADVANTAGES AND INDUCTIUAL 

mined. The eight next nearest samples are retneved Amn ii^mr 

from memory and the mean S of the eight next nearest APPXJCABILrrY 

samples is found. Then the CLIP function The signal processing method has the advantage of 

reducing the reconstruction errors in an image repro- 

Y = cuPc^(Af ~ iS~M}) 40 duced from a sampled image signal. In one mode of the 

invention for processing human viewable images, the 

s used to define the interpolated value X=Y. signal processing method has the further advantage of 

If the pattern is a CORNER, the interpolated value is improving the appearance of a reproduced image by 

found as shown in FIG. 14. First the median M of the causing the reconstruction errors to occur prindpdly in 

four nearest neighbors is determined. The four next 45 parts of the image (natural textures) where they are not 

nearest neighbors that straddle the boundary between noticeable to the human observer. The invention also 

the hght and dark members of the four nearest neigh- ^as the advantage that when used to process a signal 

bors are retneved from the frame store and their mean u„ ;«o„* ^^^^^ «f « «™ o« 

S' is found. M and S' are then used in the CLIP func- Produced by an image sensor of a given sac, an miage 

- 1^ -o*^ *u M.*- x^*^** produced havmg the same apparent image qual- 

ity as Uie conventionally processed image reproduced 
from the signal from an image sensor having many more 

Z = CUPcriM - (5* - Af)) image sensing elements. The invention is useful in ama- 

, ^t--^ i^j 1 vrr ^iri. tcur Or profcssioual vidco aud Still imaging appaTatus, lu 

to determme the mterpolated value X=>Z. When the Kranhic arts apDaratus for renroduc^ imaaes from 

interpolated value is found, the value is stored in the 55 ... , . j- t.. * 

frame store and the program returns to the begimiing to ""^P """8^ ""Snak "nd m machme vision systems, 

compute the next interpolated value. The process is . ... 

repeated witil aU the interpolated values between sam- , L A sigiml processmg method for producmg mterpo- 

pie values in the sampled luminance signal have been ^^^^^ "Snal values between sampled signal values m a 

provided. Alternatively, the computer calculates the 60 sampled miage signal produced by a checkerboard sam- 

interpolated values, combines the interpolated values P^S pattern characterized by: 

with the sample values, and displays the processed sig- providing a plurality of different interpolation rou- 

nal real time. for producing interpolated signal values that 

The signal processing method was applied to sampled complete a respective plurality of known geometri- 

image signals generated by sampling several high reso- 63 cal image features, including edges, stripes and 

lution photographic images with a checkerboard sam- comers, the geometrical features being detected by 

pling pattern. The apparent quality of the images repro- the values of the four nearest neighboring samples 

duced from the processed signals was improved over such that the patterns: 
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their rotations and mirror images are detected as edges, 
the patterns; 
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10 



their rotations and mirror images arc detected as stripes, 
and the pattern 



X - CLIP (M-(S-M)) 
C 



where: 

X is the interpolated value, 

A^B^C^D are the values of the four nearest 

neighboring samples in rank order, 
M is the median value of the four nearest neighboring 



35 



S is the mean value of the eight next nearest neighbor- 
ing samples; and 



10 



sampled image signal produced by a checkboard sam- 
pling pattern, comprising: 
a plurality of signal processing means responsive to 
. sampled signal values in the neighborhood of an 
interplation location for producing interpolated 
signal values appropriate for completing a respec- 
tive plurality of known geometrical features, in- 
cluding edges, stripes, and comers, the detecting 
means being responsive to the four nearest neigh- 
boring sample values to produce a signal represent- 
ing the patterns: 



15 



H 
L H 
L 

its rotations and mirror images are detected as a comer, 
where 20 
m is the mean value of the four nearest neighboring 
samples, 

H indicates a sample value greater than the mean, 
L indicates a sample value less than the mean; and 
the interpolation routine for edge features comprises 25 
producing the median value of the four nearest neigh- 
boring samples; the interpolation routine for the stripe 
feature comprises producing the value of the clip func- 
tion 

30 



H L H m m L 
HLLHHLHLmmLH 
H L ID n in in 



their rotations and reflections as edges, the patterns; 



H H L H 
LLLLHHLm 
H in m in 



their rotations and reflections as stripes, and the pattern 



H 
L H 
L 



40 



its rotations and reflections as a comer, where: 
m is the mean value of the four nearest neighboring 
samples, 

H indicates a sample value greater than the mean, and 
L indicates a sample value less than the mean; and 
the signal processing means include means for produc- 
ing a signal representing the median value of the four 
nearest neighboring samples for the edge feature mean 
for producing a signal representing the value of the clip 
function for the stripe feature 



X - CLIP (M-(S-M)) 

c 



CLIP ' (i) - jifj S i 

iifk ^ i g j 
kifi S k; 



the interpolation routine for comer features comprises 
producing the value of the clip function 



= CUP (M-(S'-M)) 

c 



45 where: 

X is the interpolated value, 

A^BSC^D are the values of the four nearest 
neighboring samples in rank order, 

M is the median value of the four nearest neighboring 
50 samples, 

S is the mean value of the eight next nearest neighbor- 
ing samples; and 



CUPj/W-yifys/ 



where: 55 

S' is the mean value of the four next nearest neighbor- 
ing samples that straddle the boundary between the 
light and dark members of the four nearest neigh- 
boring samples; means for producing a signal representing the value of 

detecting which of the known geometrical image 60 t^e clip function for the comer 
features is represented by a neighborhood of sam- 
ple values; and 

applying the interpolation routine appropriate for 
completing the detected feature to the neighboring 
sample values to produce the interpolated signal 65 
value. 

2. Signal processing apparatus for producing interpo- 
lated signal values between samples signal values in a 



B 

t CUP (M- 
c 



(S'-M)) 



where: 

S' is the mean value of the four next nearest neighbor- 
ing samples that straddle the boundary between the 
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light and dark members of the four nearest neigh- 
boring sample values; 
feature detecting means, responsive to sampled signal 
values in the neighborhood of an interpolation ^ 
location for detecting which of the plurality of 
known geometrical features is represented by the 



12 

sample values in the neighborhood and producing a 
signal representative thereof; and 
signal processor selection means responsive to the 
signal produced by the feature detecting means for 
selecting an appropriate one of the plurality of 
signal processing means for producing the interpo- 
lated signal value. 
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